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Mission 

Integrate,  Explore,  and  Develop  Robotics,  Network  and  Control  Components  with  a  Focus  on  Customer 
Driven  Requirements  to  Provide  Full  System  Solutions  to  the  War  Fighter 
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Integration  Technology  Development  Lessons 
Learned  to  Enable  Early  Technology  Insertion 


Military  Relevant  Test 
&  Experimentation 


Tech 

Transfer 


SME 

Defined 

Scenario 


Convoy  Active  Safety  Technologies 
War  Fighter  Experimentation  #1 


Transition  and  Requirements 
Development 


Future  Force  SMI 
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Human  Robotic  Interaction  Research 

Areas 


Tactical  behaviors 


Human  -  Robot  Interface 
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Crewstation  Advancements 
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PAST 

•Workload  reduction 
•Embedded  crewstation 


PRESENT 


FUTURE 


•Robotic  control  (mounted,  dismounted) 
•Driving  aids  (Soldier  assist) 

•Scalable,  portable  Interface 


•Soldier  monitoring  and  task  assist 

•Intelligent  agents 

*360  degree  situational  awareness 
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Robotics  Collaboration  (RC) 


Purpose:  Develop  the  tools,  techniques,  &  autonomy  to 
maximize  mounted  and  dismounted  control  of  ground 
and  air  unmanned  systems  and  optimize  Soldier-robot 
and  robot-robot  ground  and  air  teams 

Scalable  Interface: 

-  Increased  scalability,  portability  and  tailorability  of  Soldier 

Machine  Interface — reduces  training  burden 

-  Control  multiple  unmanned  system-  one  device  can 

support  unique  robots  from  different  vendors 

Driving  Aids: 

-  Enables  Soldiers  to  take  actions  of  a  semi-auto  vehicle 

while  staying  in  obstacle  avoidance 

-  Increased  mission  OPTEMPO,  reduced  intervention  times 

-  Provides  Situational  Awareness  of  unmanned  system 

-  Increased  insight  in  unmanned  system  planning  activities 
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Improved  Mobility  and  Operational 
Performance  through  Autonomous 
Technologies  (IMOPAT)  ATO 


TI=inSDt=i 


Near-field  Sensor  Coverage  &  state  classification 


Advanced 
Crew  Stations 


Enhance,  Integrate  and  Demonstrate 
360/90  LSA/Assisted  Mobility/Human 
Dimension  to  Maximize  Indirect  Vision 
360/90  LSA  and  Mobility  Capabilities 
(Secure  Mobility) 


*  Focus  on  closed-hatch  operations,  indirect 
vision 

*  360/90  degree  local  area  awareness 

*  Improved  mobility  via  non-LADAR  and  LADAR 
based  solutions 

*  Improved  assessment  and  integration  of 
operator  performance  in  real-time 

*  Increase  situational  awareness  for  all  crew 
members 
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Manned  Vehicle  Robotic  Control 
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Robotics  Collaboration  ATO 
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Improved  Mobility  and  Operational 
Performance  through  Autonomous 
Technologies  (IMOPAT)  ATO 
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Near-field  Sensor  Coverage  &  state  classification 


Advanced 
Crew  Stations 


Enhance,  Integrate  and  Demonstrate 
360/90  LSA/Assisted  Mobility/Human 
Dimension  to  Maximize  Indirect  Vision 
360/90  LSA  and  Mobility  Capabilities 
(Secure  Mobility) 


*  Focus  on  closed-hatch  operations,  indirect 
vision 

*  360/90  degree  local  area  awareness 

*  Improved  mobility  via  non-LADAR  and  LADAR 
based  solutions 

*  Improved  assessment  and  integration  of 
operator  performance  in  real-time 

*  Increase  situational  awareness  for  all  crew 
members 
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Following,  Awareness,  Safe-Ops,  and  Tracking 
through  Intelligent  Ground  Systems  (fastIGS) 
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Purpose: 

Integrate,  enhance,  and  demonstrate  a  360° 
Spatial  Awareness  System  using  Ultra  Wide 
Band  for  Dismounted  Following  and 
Mounted  Autonomous  Tactical  Behaviors. 

Payoff: 

Drastically  minimizes  the  amount  of  soldier 
intervention  required  to  take  unmanned 
systems  along  in  dismounted  operations. 
Provides  360°  Spatial  Awareness  for  all 
assets  in  the  system  (manned  and 
unmanned). 
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Goals  &  Objectives 


360/90  Day/Night  ■(, 
Near-field  Sensor  Coverage 


Advanced 
Crew  Stations 


Goals: 

To  develop  indirect  vision  /  drive  by  wire  systems  that 
provide  electro-optic  indirect  vision  based  local  situational 
awareness  and  mobility  capabilities  at  or  above  the 
performance  levels  of  direct  vision  mechanical  drive 
systems,  along  with  enhancing  high  definition  cognition 
technologies  to  dynamically  manage  workload  to  increase 
the  operational  performance  of  future  platforms. 

Objective: 

Through  the  TARDEC  led  IMOPAT  ATO  that  contains 
CERDEC-NVESD,  ARL-HRED,  and  NSRDEC  as  joint  partners, 
the  ATO  will  mature  visual  sensor  suites,  human 
integration,  and  assisted  mobility  technologies  in  three 
phases  of  evolution: 

-  Baseline:  Establish  initial  indirect  vision  driving  (IVD) 
and  360  degree  local  situational  awareness  (LSA) 
capabilities. 

-  Enhanced:  Increase  IVD  and  LSA  capabilities. 

-  Advanced:  Integrated  state  of  the  art  IVD  and  LSA 
system  providing  a  "secure  mobility  capability". 


Soldier  Monitoring 
&  State  Classification 
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Activity 

FY09 

FY10 

FY11 

FY12 

GCV  Milestones 

Prime  Contract  Awarded 

August  2010  Demonstrator  (360  Vision  SA) 


RFP  0 


Selected  Contractors 

Competitive 

Desian/Develooment 

Subsytem 

Testina 

Integrate  360  SA  Sensors 
Integrate  Commander  WMI  Software 
Upgrade  Drive  By  Wire 
Upgrade  Digital  Video  Architecture 
360  LSA  Demo  (Ft.  Hood) 

Enhanced  Experiment  -  Final  360  Vision  SAand  DVA 

Integrate  Final  360  LSA  Sensors 
Integrate  Final  DVA 

Integrate  Final  (GCV  Version)  Commander  &  Driver  WMI  SW 
Integrate  HD-Cog  Sensors*,  DVR  (if  available) 

Conduct  Experiment  (Ft.  Hood*) 

Capstone  Engineering  Evaluation  Test  (EET) 


Integrate  Upgraded:  WMI  SW,  360  SA  Sensors,  HD-Cog 
Sensors/Algorithms,  DVR 

Integrate  Additional  LSA  Sensors  (Acoustic  Sensors, 
Enhanced  CROWS,  Commander’s  Gimbal,  Virtual  Pointer), 
OTM/MTI,  OA,  Dismount/Squad  Leader  Display 

Conduct  EET  (Ft.  Hood**) 

Capstone  (Ft.  Hood*) 


i  i 


[ 


UNCLASSIFIED 


HDBCOM 


Partnerships 


TFinSDtEi 


UNCLASSIFIED 


TECHNOLOGY  DRIVEN.  mA&FIGHTER  F&&JSED. 


RDFCOM 


Military  Relevance 
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•  Intelligent  Ground  Systems  ATO  Operational  Concept  Development 

-  Op  Orders:  Secure  building  in  urban  environment  utilizing  manned  and  unmanned 
assets 

-  Slide  Show  Description 

-  Animation  Video 

•  Improved  Mobility  and  Operational  Performance  through  Autonomous  Technologies 
(IMOPAT)  ATO  Technologies: 

-  Electro-optic  based  indirect  vision  driving  and  local  situational  awareness 

»  Crewstations  &  warfighter  machine  interfaces 
»  Mobility  aids 

»  Crew  and  squad  local  situational  awareness 
»  Aided  target  and  threat  cueing 

»  Assisted  slew  to  cue  threat  interrogation  and  response 
»  Digital  video  recording  of  360  degree  environment 
»  Unmanned  vehicle  situational  awareness,  control  and  handoff 
»  High  Definition  Cognition  Elements  -  Not  Illustrated 

•  Safe  Operations  of  Unmanned  Systems  for  Reconnaissance  in  Complex  Environments 
(SOURCE)  ATO  Technologies 

-  Safe  operation  of  unmanned  ground  vehicles  in  a  complex  urban  environment 

-  Small  unmanned  ground  vehicle  based  building  mapping 

-  Show  Video:  IGS  ATO  Operational  Concept 
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Key  Features 

Adjustable  seats,  pedals,  hand 
controllers,  and  display  to  fit  a  wide  range 
of  the  population 


Four  17”  display  that  meet  FCS’s 
requirements.  Three  displays  for  the 
driver  (left  side),  one  display  for  the 
commander  (right  side). 

4  Warfighter  Machine  Interface  (WMI) 

PCs  (one  for  each  display). 

Four  Video  Processing  Unit  (VPU)  (one 
VPU  for  each  display).  The  VPU’s  are 
capable  of  inputting  four  video  inputs. 

Then  overlaying  the  WMI  and  outputting 
the  merged  image  to  the  display. 

Figure:  SCCS  System  Integration  Lab  (SIL).  There  is  an 
identical  SCCS  in  TARDEC’s  Crew  Automation  Testbed 


(CAT).  The  CAT  is  a  Ml  126  ICV. 
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Commander  Local  Situational  Awareness 


Condition  1  Condition  2  Condition  3  Condition  4 


Design 


Color 

Sensor 

View 


f  \ 

C4  design  modification:  crop  banners,  expand  sensor  view 
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•  These  reference  documents  were  used  to  create  IMOPAT  Use  Cases: 

-  IMOPAT  Operational  Concept  document  -  primary  reference 

-  IMOPAT  ATO  Charts 

-  Role  to  (vehicle)  position  matrix 

-  MGV  Role  White  Paper 

-  User  Interface  (Ul)  Spec  List 

-  FCS  Target  Audience  Description 

-  ARL  FCS  IMPRINT  models 

-  MGV  Ul  Book 

•  After  the  reference  materials  were  collected  and  studied,  the  IMOPAT 
Function/Task  List  and  Roles  were  derived 

•  The  Use  Cases  were  created  leveraging  the  function/task  list  and  roles.  A 
format  was  followed  &  change  management  was  performed  for  each  Use  Case. 

•  7  Use  Case  Types: 

-  Mission  Planning  and  Execution 

-  Control  Manned  Vehicle 

-  Command  Vehicle 

-  Local  SA 

-  Control  Unmanned  Vehicle 

-  Communications 

-  Enemy  Engagement** 
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Urban  Sensor  Suite 
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Closed  Hatch  Hemispherical  Vision  Integrated  with 

Threat  Cueing ,  Video  Capture,  and  Slew  to  Cue  Interrogation 


TO/7D 


Target  Handoff 
via  Virtual 


4 


“Green” 


ointer  in 
Weapon 
Sight  for 
target 
handoff 
between 
SUGV  and 
Dismounts 
SUGV  with 
SWIR  Zoom 


Improved 
Driving  and 
Threat  Detection 


High  Frontal  Resolution 
Closed  Hatch 
360  Vision 


Sensors,  System  Processor, 
Controls  and  Displays 


Threat  Cueing  &  lmaf 

pture  Improved  SA 
and  operator 
workload 
reduction 


Acoustic 

Gunfire 

Detection 


Motion  Based  Cueing  for 
Pop  Up/Close-ln  Target 
Detection 


Laser 
for  Non- 


Lethal 


Slew  to  Cue  via 
High  Resolution 
Imager  (e.g. 
Enhanced 
RWS/CROWS) 


Rapid  Slew  to 
Cue  from  360 
Vision  to  High 
Resolution 
Imager 


WFOV  Inset  into  360°  Vision 
With  Touch  Screen  GUI 


Commander’ 
s  Gimbal 
w/Non-Lethal 
Suppression 

f 

Separate 
Stabilized  Gimbal 
(automatic  & 
manual  modes) 


Enabler  for  Improved  Survivability  and  Lethality 
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Human  Performance 
Research  &  Experimentation 
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•  Indirect-vision-based  intelligent  manned 
and  unmanned  vehicle  mobility 

•  Mode-switching  for  driving 


•  Soldier-machine  interface  design  to  enable 
local  area  security 


•  Cueing  for  crew  task  management  for  local 
area  security  and  vehicle  mobility 

•  Soldier  monitoring/state-based  advanced 
crewstation  design  for  enhanced  Soldier 
performance. 
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HD-Cog  Objective 

To  integrate  “high  definition”  assessments  of  Soldier  cognitive  function 
into  neuroergonomically-designed  controls  and  displays 

Focus  on: 


•  Visual  scanning 

•  Platform  control 

•  Spatial  cognition 

•  Decision  making 


Develop  Neuroergonomically-designed 
Guidelines  for: 

•  Sensor  &  DAQ  Infrastructure 

•  Signal  Processing  &  Cognitive 
Assessment 

•  Real-time  Techniques  to  Enhance 
Soldier-System  Performance 

Predictive  Model  of  Spatial  Cognition 

Operationally-relevant  Cognitive 
Metrics 
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Problem:  Dismounting  infantry  “ride  blind”  to  the  state  of  the  battlespace,  unable  to 
update  their  dynamic  location  to  prepare  for  efficient  operations. 

Purpose:  Perform  human  subjects  research  and  provide  data  to  guide  down- 
selection  of  form  factors  and  organizational  principles  to  enhance  Soldier  rapid 
development  of  spatial  awareness  immediately  prior  to  dismount. 

Results/Products:  Cognitive  task  analysis  and  research-based  principles  for  form 
factor  selection  and  visualizations  to  promote  dismount  SA. 

Payoffs:  Improved  dismount  orientation  and  navigation  performance,  improved 
survivability  and  enhanced  mission  effectiveness. 


Enhance  Soldier  situational 
awareness  by  porting  crew  station 
data  streams  to  dismounting  Infantry. 


Facilitate  efficient  and  accurate 
orientation  and  movement  to 
objectives,  and  mission  success. 
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•  Combines  synchronized  range  data  and  image 
data  to  create  a  3D  virtual  model  of  the  world  in 
real-time. 

•  Allows  the  operator  to  select  an  arbitrary  “third- 
person”  viewpoint  such  as  bird’s  eye,  over  the 
shoulder,  etc. 

•  Compensates  for  latency  using  operator  input 
and  motion  prediction  to  update  the  virtual  model 
on-the-fly. 

•  Maintains  a  database  of  virtual  “breadcrumbs” 
in  the  form  of  a  path  that  allows  an  operator  to 
distinguish  between  previously  visited  and 
unexplored  areas. 

•  Current  efforts  are  exploring  usage  of  a 
passive  stereo  vision  system  instead  of  a  laser 
range  finder  for  geometrical  information. 


FY  2007 


Phase  IV  Start 
(Passive  SACR) 


FY  2010 


Phase  II  Start 

Demonstration  at  Robotic  Collaboration  (RC) 

ATO  Capstone  Event 
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